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ABSTRACT 


The  development  of  continuous  sampling  STD  (salinity-temperature- 
depth)  sensors  as  a  prime  data  collection  tool  for  oceanographic  cruises  has 
necessitated  the  development  of  techniques  capable  of  handling  the  data  with 
modern  digital  computing  equipment.  This  paper  describes  one  such  tech- 
nique that  was  developed  for  processing  STD  data  collected  as  part  of  the 
EASTROPAC  Survey  Program.  The  description  assumes  that  the  data  has 
been  digitized  and  recorded  on  IBM  compatible  tape  in  the  field.  The  compu- 
ter programs  needed  for  processing  the  basic  data  tapes  are  described,  and  a 
listing  of  the  program  with  subroutines  is  given  in  the  Appendix. 
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Processing  of  Digital  Data  Logger  STD  Tapes 

at  the 

Scripps  Institution  of  Oceanography 

and  the 

Bureau  of  Commercial  Fisheries, 

La  Jolla,  California 


By 
JAMES  H.  JONES,  Oceanographer 


Scripps  Institution  of  Oceanography 
La  Jolla,  California  92037 


INTRODUCTION 

As  part  of  the  EASTROPAC  Survey  Pro- 
gram, computer  programs  were  developed  to 
process  STD  (salinity-temperature-depth)  data 
from  Bisset-Berman  model  9006  systems,"  and 
record  them  on  incremental  IBM  compatible 
DDL's  (digital  data  loggers),  also  manufactured 
by  the  same  company.  The  accuracy  and  pre- 
cision of  these  two  instruments  are  described 
in  the  manufacturing  brochures  and  are  not 
discussed  here.  During  the  EASTROPAC  Pro- 
gram, about  10,000  m.  of  field  tapes  were 
generated  which  required  editing  and  data 
processing. 

The  purpose  of  this  paper  is  to  describe 
the  methods  developed  for  processing  the  field 
tapes  to  a  point  where  the  data  produced  from 
them  may  be  compared  with  some  independent 
calibration  such  as  conventional  Nansen  casts 
or  Niskin  samplers,  attached  to  the  STD's. 

In  its  present  form,  the  DDL  samples  each 
of  four  channels  of  information  about  once 
every  0.2  second,  and  writes  a  seven-channel 
IBM  compatible  tape  at  a  bit  density  of  200 
bits  per  inch.  At  a  drop  rate  of  60  m.  depth 
per  minute,  salinity,  temperature,  depth,  and 
the  optional  sound  velocity  channel  are  sam- 
pled five  times  in  each  1-m.  interval.  Since  the 


uncertainty  of  the  depth  sensor  is  about  1  m., 
at  this  maximum  sampling  rate,  five  values  of 
temperature  and  salinity  are  available  to  pro- 
duce one  value  per  meter.  The  program  de- 
scribed below  is  based  on  the  premise  that  the 
original  field  tapes  are  recorded  at  this  maxi- 
mum rate.  Slower  sampling  rates  require  slight 
modification  of  the  low-pass  filters  used  in  the 
program.  The  fourth  and  optional  channel  of 
sound  velocity  is  not  used  on  any  STD  systems 
of  the  Scripps  Institution  of  Oceanography,  or 
the  Bureau  of  Commercial  Fisheries;  therefore 
no  description  of  schemes  to  process  the  op- 
tional channel  is  included. 


PRELIMINARY  PROCESSING 

When  the,  field  tapes  are  received  at  the 
data-processing  center  they  are  first  passed 
through    a   computer   routine   which   examines 


l\Vork  for  this  manuscript  was  done  while  the 
author  was  employed  by  the  Bureau  of  Commercial  Fish- 
eries Fishery-Oceanography  Center,  La  Jolla,  Calif. 
92037. 

^Use  of  trade  names  does  not  imply  endorsement 
by  the  Bureau  of  Commercial  Fisheries. 


them,  file  by  file,  and  lists  the  binary  length  of 
the  first  record  as  well  as  the  total  number  of 
records  per  file.  Any  parity  errors  in  the  records 
examined  are  also  listed. 

The  ideal  field  tape  contains  no  parity  er- 
rors. The  first  record  of  the  first  file  is  an  infor- 
mation record  and,  in  the  format  used  by  us,  is 
a  three-digit  number  signifying  the  cast  number 
for  that  particular  cruise.  The  binary  length  of 
this  record  is  always  1.  The  second  file  consists 
of  the  data  recorded  by  the  data  logger  and  may 
contain  any  number  of  records  depending,  among 
other  things,  on  the  maximum  depth  attained 
and  the  drop  rate.  A  500-m.  cast  at  a  drop  rate 
of  60  m.  per  minute  has  about  50  records  per  file. 

In  its  present  form  the  data  logger  is  de- 
signed to  produce  a  binary  data  record  length  of 
52.3  xhus,  in  the  ideal  field  tape  the  files  alter- 
nate between  an  information  file  containing  only 
one  record  with  a  binary  length  of  1  and  a  data 
file  with  many  records,  all  with  a  binary  length 
of  52.  The  preliminary  listing  of  the  field  tapes 
provides  the  programmer  with  a  picture  of  how 
far  his  tapes  deviate  from  the  ideal.  If  the  con- 
tents of  the  first  record  are  printed  during  the 
preliminary  listing,  the  cast  numbers  may  be 
identified  with  individual  data  files. 

The  next  step  in  the  data  processing  is  to 
produce,  from  the  field  tapes,  a  high-density  tape 
which  is  free  of  parity  errors  and  other  anomalies 
which  confuse  the  tape  translation.  In  the  trans- 
fer from  low-  to  high-density  tape,  we  have  cho- 
sen to  eliminate  all  records  containing  parity 
errors  and  records  not  of  binary  length  1  or  52. 
Our  experience  is  that  we  lose  no  more  than 
3  percent  of  the  original  data  in  this  way.  The 
high-density  tape,  free  of  tape  errors,  is  then 
considered  to  be  the  basic  data;  the  original 
field  tapes  are  erased,  checked  and  readied  for 
the  next  cruise. 


THE  PROGRAM 

The  program  and  subroutine  functions 
are  outlined  in  figure  1,  and  a  listing  of  the 
program,  as  run  on  the  CDC  3600  at  UCSD 
(University  of  California,  San  Diego),  is  pro- 
vided   in    the    Appendix.    The    main    program 


RDEDTP  (read  and  edit  tape)  reads  in,  from 
cards,  a  list  of  the  files  to  be  translated  from 
the  basic  tape  and  a  list  of  station  numbers  that 
are  to  be  associated  with  data  lists.  The  file 
containing  the  station  number  is  read  and  trans- 
lated if  it  is  in  the  proper  format.  If  it  is  missing 
or  in  an  improper  format,  as  determined  from 
the  preliminary  tape  listing,  the  proper  station 
number  is  determined  from  a  logbook  for  the 
data  logger  and  is  read  in  from  a  card. 

The  first  subroutine,  TRANS,  translates, 
record  by  record,  the  digitized  frequencies 
into  salinity  in  parts  per  thousand,  temperature 
in  degrees  Celsius,  and  depth  in  meters.  Maxi- 
mum and  minimum  bounds  are  specified  for 
the  depth  so  that  any  values  outside  these 
limits  are  rejected. 

During  the  field  operations,  the  sensor 
package  is  sometimes  temporarily  stopped  at  an 
intermediate  depth  to  make  adjustments  to  the 
pens  or  the  winch.  The  data  logger  is  usually 
left  running  on  these  stops,  but  the  records 
are  of  no  use  in  producing  a  vertical  profile; 
subroutine  BASKET  is  accordingly  called  to 
delete  the  records  where  the  depth  has  not  in- 
creased. The  final  control  is  a  counter  which 
provides  for  a  jump  out  of  TRANS  before 
memory  overflows  can  occur. 

A  sample  output  of  the  record  produced  by 
subroutine  TRANS  is  given  in  figure  2.  The 
fourth  column  of  each  set  is  an  absolute  counter 
for  the  file,  which  increases  only  when  an  accept- 
able set  of  salinity,  temperature,  and  depth  is 
translated.  When  the  lower  depth  bounds  are 
exceeded,  the  counter  is  not  increased  and  that 
set  of  data  is  not  saved  for  transmittal  to  the 
smoothing  subroutine.  The  0's  printed  at  the 
beginning  of  the  file  in  the  first  record  indicate 
nonacceptable  data,  since  the  depth  is  less  than 
the  minimum  of  -0.2  m.  set  in  the  subroutine. 
In  the  first  record  of  this  file  only  16  sets  of 
salinity,  temperature,  and  depth  were  acceptable. 

Between  TRANS  and  the  next  subroutine, 
the  maximum  and  minimum  values  of  salinity, 


^The  magnetic  tape  record  is  416  tape  frames  long, 
which  is  the  equivalent  of  52  computer  records. 


COMPUTER  PROGRAM  LINKAGE 

FOR 
PROCESSING  DIGITAL  STD  TAPES 


Program  RDEDTP 


Inputs  for  STD  and  DDL  constants. 
Reads  files  to  be  processed  and  station 
numbers  to  be  added. 


Subroutine  TRANS 
Translates  binary  representations  of  STD 
frequencies  to  engineering  units. 
Performs  minor  preliminary  editing. 


Subroutine  BASKET 
Compares  adjacent  records  and  discards 
those  showing  no  depth  change. 


Subroutine  SMOOTH 
Applies  a  double  running  mean  to  all 
three  channels  and  decimates  after 
the  second. 


Subroutine  INTERP 
Looks  at  depth,  temperature  and  salinity 
on  a  one  meter  interval  and  either  averages 
or  interpolates  values  of  temperature  and 
salinity   for  each   meter. 
Output   statements. 


Subroutine  SALTFX 
Applies  dT/dt  corrections  to  salinity 
values. 


Figure  1  .-Computer  program  linkage  for  processing  digital  STD  tapes. 
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temperature,  and  depth  as  well  as  the  total 
number  of  values  retained  are  printed.  This 
printing  gives  a  check  that  determines  whether 
any  unrealistic  values  were  used  in  the  subse- 
quent filtering  and  averaging  routines. 

The  third  subroutine,  SMOOTH,  performs 
low-pass  filtering  to  the  three  channels  and  deci- 
mates. The  low-pass  filters  are  a  running  mean; 
the  numbers  for  the  averages  depend  on  the  re- 
cording and  drop  rates.  Since  our  procedures 
normally  produce  about  five  values  every  meter, 
a  running  mean  of  5  is  applied.  Decimation 
occurs  after  the  second  running  mean  and  depth 
values  are  rounded  to  the  closest  1-m.  interval. 

The  final  subroutine,  INTERP  (interpret), 
is  an  averaging  and  interpolation  package.  Values 
of  temperature  and  salinity  that  occur  in  the 
same  1-m.  interval  are  averaged.  Where  there 
are  no  values  in  a  meter  interval,  one  is  linearly 
interpolated  from  adjacent  values.  After  this 
procedure,  subroutine  SALTFX  (salt  fix)  is 
called  and  salinity  values  are  corrected  for  swift 
changes  in  the  temperature  gradient  according 
to  the  formula: 


(IS) RiKS' 


where    S'  is  the  apparent  salinity 

?-  is  the  rate  of  change  of  temperature 

dz  with  depth 

K  is  a  constant  (-  -0.09  p.p.t.  per  i°C.) 


t      is    a    thermometer    time    constant 
e0.35  sec.) 

and        R       is  the  drop  rate. 

A  final  output  statement  follows  this  last  sub- 
routine. 

Figure  3  represents  the  final  output  from 
the  data-processing  program.  Preceding  the  data 
are  the  station  number  and  the  total  number  of 
observations  within  the  bounds  set  in  TRANS 
and  transmitted  to  subroutine  SMOOTH.  Below 
are  the  maximum  and  minimum  values  of 
salinity,   temperature,   and   depth  used  by  the 


smoothing  subroutine.  Finally,  the  number  of 
data  sets  transmitted  from  SMOOTH  to  the  final 
subroutine  INTERP  are  given.  The  data  interpo- 
lated to  a  1-m.  interval  follow  below. 

A  comparison  of  the  DDL  output  with  the 
analog  output  of  the  STD  is  presented  in  fig- 
ures 4-6.  A  600-m.  station  was  chosen  for  the 
comparison  as  it  presents  most  of  the  features 
normally  encountered  on  an  STD  cast.  Figure  4 
is  a  reproduction  of  a  cast  made  near  the  equa- 
tor in  the  eastern  Pacific.  The  surface  tempera- 
ture and  salinity  noted  at  the  top  of  the  trace 
were  determined  from  a  continuous  recording 
surface  TS  recorder,  periodically  checked  by 
bucket  temperature  and  surface-water  sample 
salinity.  The  numbers  adjacent  to  the  profiles 
represent  the  salinity  scale  (4)  and  the  tempera- 
ture scales  (6,  ,  3)  used  during  the  cast.  The 

salinity  trace  is  displaced  upward  (toward  a 
shallower  depth),  by  5  m.  on  the  depth  scale, 
from  the  temperature  to  allow  the  two  pens 
to  cross  without  interfering  with  one  another. 
This  particular  paper  does  not  have  the  scales 
printed  directly,  but  they  are  identical  to  those 
at  the  bottom  of  figure  5.  The  spikes  in  the 
salinity  trace  are  a  feature  common  to  almost 
all  STD  casts.  They  are  considered  to  be  a  re- 
sult of  a  failure  of  the  electronic  system  in  the 
salinity  sensor  to  respond  to  sudden  changes  of 
the  temperature  gradient  and  do  not  reflect  the 
true  salinity  at  those  locations. 

Figure  5  is  a  computer  generated  plot  of 
the  1-m.  values  as  output  from  the  data  pro- 
cessing program.  The  scales  are  identical  to 
those  of  figure  4.  The  temperature  profile  is 
identical  to  the  analog  plot  reproducing  fully 
temperature  inversions  and  sudden  changes  in 
gradient.  The  salinity  trace,  when  the  vertical 
pen  displacement  is  accounted  for,  is  also  re- 
produced with  some  spikes  totally  eliminated 
and  others  partially  eliminated.  The  failure  to 
eliminate  all  the  salinity  spikes  reflects  the  fact 
that  not  all  the  spike-forming  processes  are 
known.  The  manufacturer  has  recently  noted 
that  there  is  an  intermittency  in  a  portion  of 
the  electronic  system  that  responds  to  a  sudden 
change  in  temperature  gradient  as  well  as  a  lag 
response  function  in  the  operation  of  the  con- 
ductivity to  salinity  circuitry.  The  manufacturer 


claims  to  have  remedied  this  circuitry  problem  It  is  for  these  reasons  that  additional  filter- 
in  the  newer  model  9040  STD  system.  In  addi-  ing  is  applied  to  the  salinity  trace  alone.  Fig- 
tion,  the  numbers  used  in  the  salinity  correction  ure  6  presents  a  running  mean  of  10,  applied  to 
formula  given  above  are  only  approximate  and  the  salinities  used  to  produce  the  profile  in  fig- 
may  be  seriously  in  error  for  some  instru-  ure  5.  The  type  of  secondary  salinity  filtering 
ments  and  for  very  different  drop  rates  than  will  ultimately  depend  on  the  user's  application 
assumed  here.  of  the  data. 
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cruise  75  (15  February  to  15  April  1968).  Cast  was  to  600  m.  Surface  salinity  and 
temperature  at  top  of  figure  were  determined  from  continuous  recording  surface  TS  recorder. 
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Figure  5. -A  plot  of  the  processed  digital  data  logger  values  as  output  from  the  data 
processing  program.  Salinity,  temperature,  and  depth  scales  are  identical  to  those 
in  figure  4. 
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Figure  6.-Plot  of  processed  values  with  additional  filtering  applied  to  the  salinity 
values.  The  scales  are  identical  to  those  in  figure  5. 
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CONCLUSIONS 

The  computer  program  discussed  here  pre- 
sents one  approach  to  the  data  processing  of 
STD  digital  data  logger  tapes.  There  are  un- 
doubtedly many  alternative  techniques  which 
may  do  just  as  well.  The  system  described  above, 
however,  has  the  virtue  of  having  been  used 
for  nearly  2  years,  and  it  is  felt  that  this  pro- 
gram produces  a  set  of  data  which  most  nearly 
represents  the  signals  generated  by  the  STD 
sensor  package,  in  a  form  easily  interpreted  by 
most  of  those  who  need  to  work  with  the  data. 

The  additional  problems  of  relating  these 
data  with  independent  measurements  and  of 
eliminating  random  and  systemic  errors  are 
peculiar  to  individual  instruments,  cruises,  per- 
sonnel, and  techniques,  and  almost  always  must 


be  determined  by  the  experimentor.  The  method 
used  on  the  EASTROPAC  data  was  to  take  the 
output  of  the  program  described  here,  compare 
these  data  with  the  independent  calibrations, 
and  then  correct  on  the  computer  for  any  drift 
or  offset  noted  during  the  cruise.  In  addition, 
the  salinity  trace  is  filtered  to  produce  a  profile 
similar  to  that  shown  in  figure  6. 
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APPENDIX 


A  listing  of  Program  RDEDTP  and  subroutines  as  used  on  the  University 
of  California,  San  Diego  CDC  3600  computer.  Questions  concerning  indi- 
vidual library  subroutines  should  be  directed  to  the  UCSD  computer  center, 
LaJolla,  Calif.  92037. 
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